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Sir; 



I, Charles R Yount declare: 

1 . I am an inventor of the claims of the above-captioned patent appUcation ("the 
AppUcation") and the inventor of the subject matter described therein. 

2. At least prior to June 3. 1997, the filing date of U.S. Patent No. 6,347,388 cited 
an Office Action mailed September 10, 2003, the invention claimed in the 
AppUcation had been conceived and reduced to practice in the United States. 

3. Attached Exhibit A, dated April, 1997, is an invention disclosure fonn describing 
the design of the Method and Apparatus for Generation of Validation Tests. 
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Declaration Under Rule 1.131 
in Support of Application 
Application No. 09/475,526 



4. Exibit A discloses using search techniques which rely on interactive improvement, 
and use functional coverage as a feedback mechanism to guide these techneques. 
The interative search techniques navigate through a space of potential solutions by 
evaluating a subset of those solutions, and then using those evaluations to choose 
new solutions until an optimal solution is found. The framework of this method 
includes a test generator (TG), a test analyzer (TA) with coverage monitors, and a 
feedback engine (FE). See Exibit A at page 1, paragraphs 4-7. This basic flow is 
given in the following psuedo-code: 

Generate or otherwise acquire initial test(s). 

Evaluate these initial test(s) based on validation coverage. 

While (coverage goal is not reached) { 

Use iterative search algorithm in FE to determine next point 
solution space. 

Use TG to generate a new test representing this point. 

Use TA to analyze test for validation coverage 

■ ■ ::, ;>.. , . ■ : ■ • 

(See Exibit A at page 2) / ' ' 

- 5. Therefore, Exibit A establishes^ that the subject inatter claimed in the Application 
had been reduced to practice in the United States prior to June 3, 1997. 

I further declare that all statements made herein of our own knowledge are true 
and that all statements made on information and belief are believed to be true; and further 
that these statements are made with the knowledge that willful false statements and the 
like so made are punishable by fine or imprisonment, or both under section 1 00 1 of Title 
1 8 of the United States Code, and that such willful false statements may jeopardize the 
validity of the application of any patent 
Dated: Ava.QJ^ . 2004 
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M,^thod for the Automatic Generation of High-Coverage Validation test Suites 
Charles Yount & Melvyn Goveas 

Over the past few years, functional validation has become one of the most critical activities 

Sn^kSn^^^^^^ T^'^ our competitors') success. As our design complexities have increased 

mr.Jr.f.LT r*'' ^^'"9" '^^^^'^^ ^^-V clear that our older, primarily 

manual validation strategies have run out of steam. ■■■■«my 

While automatic test generation has been in use for a few years, this has mostly been limited to 
random test generation. Only lately have we started to focus a considerable amount of effort on 
more directed methods. One such method, referred to as "specification-based validation " 
generates exhaustive sets of tests based on an input specification of the design to be tested In 
some sense, it is the opposite of random test-generation. However, the completeness of the tests 
generated by tools employing this strategy is directly limited by the completeness of the input 
specification, which can take a considerable amount of manual work to generate; while this form 
hp found good use for architectural-level validation (where the input specification is more-or-less 
stable over many generations), it becomes quite difficult to employ at lower levels 
(microarchitectural validation, unit validation), where the majority of the bugs are known to be found 
This IS because the specification at this level is even more detailed, and can change significantly 
from one design proliferation to the next. ^ » j 

We have come up with a unique solution that addresses this situation. By employing iterative 
search techniques to guide an automatic test generator, we believe we can significantly reduce the 
need for detailed specification input at the lower levels of the design. By instrumenting the design 
with coverage monitors, the tool is able to "learn its way around the design," so to speak and 
instruct the test generator to generate tests that will cover logic that has not yet been tested. 

We would like to patent our method of generating high-coverage validation test suites that has the 
following unique characteristics: 

1. The use of search techniques which rely on iterative improvement. 

2. The use of functional coverage as a feedback mechanism to guide these techniques 
These two major concepts are discussed In more detail below. 

Search techniques: The basic idea behind iterative search techniques is to navigate through a 
space of potential solutions by evaluating a subset of those solutions and using those evaluations 
to choose new solutions until an optimal solution is found. There is a large number of these 
algorithms in use in industry and academia. Examples include genetic algorithms, genetic 
programming, simulated annealing, neural-net training, and standard hill-climbing approaches 
Since some of these are only slight variations of others, it is important not to limit this invention to 
one particular technique. 

Coverage feedback: The second major characteristic of our invention is the use of coverage as the 
evaluation criteria to guide the iterative improvement. Othenwise, it is difficult to measure objectively 
how good a partiular functional test is. Again, there are many kinds of coverage measurements 
this invention only requires that the coverage be measureable. 

The concept we would like to patent is embodied in a framework that includes a test generator 
(TG). a test analyzer (TA) with coverage monitors and a feedback engine (FE). This basic flow is 
given in the following pseudo-code: 
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/erate or otherwise acquire initial test(s). 
/aluate these initial test(s) based on validation coverage. 
/Vhile (coverage goal is not reached) { 

Use iterative search algorithm in FE to determine next point in solution space. 
Use TG to generate a new test representing this point. 
Use TA to analyze test for validation coverage. 



plifled data-flow diagram is shown below. 
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'rfferent types of test generators might be employed, ranging from random test generators 
leiy directed test generators (including those employed for specification-based validation 

Various forms of coverage monitors may be used, ranging from manually-generated 
Int monitors (including silicon-based monitors) to automatically-generated generic 
^linitors to code coverage monitors. Finally, the test-execution medium can vary from 
led simulation to hardware-accelerated simulation to actual silicon. 

*in Technology) are currently executing a program called AutoCov, which defines the 
Scribed above and four different implementations of this framework (generated by 
'prent framework components), targeted at different validation areas, e.g., 
jidation, pre-silicon micro-architectural validation, and pre-silicon unit-level 
lye completed and demonstrated a proof-of-concept for the first of these 
VKatmai, Merced and Willamette are planning to use these tools. 



Creation process 
for each individual 
test in popuiation: 



GP Feedback Engine (FE) 



Create strategy for 
making new TGL 
program "from scratch' 




TGL Buflder(TB) 



Chcx)seoneTGL 
program based on 
coverage and create 
stralsgy for mutating it 



Choose two TGL 
programs based on 
coverage and perform 
crossover, forming a 
new TGL program 



Using strategy, direct 
Janus to add random 
instructions and dab to 
form a new TGL 
program 



Test Generator (TG) 



Use Janus to translate 
TGL irrto executable 
test 



Test Analyzer (TA) 



Execute tests on RTL 
modeiand generate 
Proto coverage data 



A? a concrete example, one olf these implementations is targeted for pre-sillcon micro-architectural 
validation. For this tool, the 
feedback engine is based 
on genetic programming, a 
sub-field of genetic 
algorithms; the search is 
thus based on modeling the 
principles of natural 
selection. Points in the 
solution space are 
represented by a special- 
purpose Test Generation 
Language (TGL). Tests are 
created, evolved or weeded 
out over time based on 
coverage; the result is an 
automatically-generated 
high-coverage test suite. 
The feedback engine guides 
a random test generator, 
Janus, and the tests will be 
executed on a software 
simulator. Coverage is 
measured using RTL event 
coverage monitors. Shown 
is a flowchart of the 
prototype system; this 
process is executed in 
parallel for each test on 
distributed workstations 
until the coverage goal has 
been met. The other three 

implementations change some or all of these components to perform other types of validation 

We believe that this is the first use of this combination of technologies in the world, and it will be 
very strategic for Intel to patent this innovation. There certainly have been other uses of iterative 
search algorithms, and some have been patented, but we know of no other application for 
generating functional tests. Also, we know of no other use of functional coverage as a mechanism 
to guide such algorithms. 

This technology would be useful to any other company performing functional validation on digital 
systems, including, but not limited to microprocessors. It could also be used used to generate 
functional test suites for software systems. Since the method used to generate tests is not 
detectable in the final product, infringement could not be detected in any way by examining our 
compeditors' products. Infringement could only be detected with knowledge of a company's test- 
generation methodology. 



Put TGL program and 
corresponding 
coverage data Mo 
population (replacing if 
necessary) 
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